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We propose and analyze a quantum version of Szilard's "one-molecule engine." In particular, 
we recover, in the quantum context, Szilard's conclusion concerning the free energy "cost" of 
measurements: AF > fcgTln2 per bit of information. 



I. INTRODUCTION 

In 1929 Leo Szilard wrote a path-breaking paper 1 entitled "On the Decrease of Entropy in a Thermodynamic 
System by the Intervention of Intelligent Beings" . There, on the basis of a thermodynamic "gedankenexperiment" 
involving "Maxwell's demon," he argued that an observer, in order to learn, through a measurement, which of the 
£H ' two equally probable alternatives is realized, must use up at least 

c3 : 

Hi . 

; AF=fc B Tln2 (1) 

7-H ! 

of free energy. Szilard's paper not only correctly defines the quantity known today as information, which has found a 
I ' wide use in the work of Claude Shannon and others in the field of communication science. 3 It also formulates physical 
connection between thermodynamic entropy and information-theoretic entropy by establishing "Szilard's limit" , the 
least price which must be paid in terms of free energy for the information gain. 

The purpose of this paper is to translate Szilard's classical thought experiment into a quantum one, and to explore 
its consequences for quantum theory of measurements. A "one-molecule gas" is a "microscopic" system and one 
may wonder whether conclusions of Szilard's classical analysis remain valid in the quantum domain. In particular, 
£C) i one may argue, following Jauch and Baron, 4 that Szilard's analysis is inconsistent, because it employs two different, 
incompatible classical idealizations of the one-molecule gas - dynamical and thermodynamical - to arrive at Eq. (1). 
We shall show that the apparent inconsistency pointed out by Jauch and Baron is removed by quantum treatment. 
O ,' This is not too surprising, for, after all, thermodynamic entropy which is central in this discussion is incompatible 
with classical mechanics, as it becomes infinite in the limit Ti — > 0. Indeed, information-theoretic analysis of the 
operation of Szilard's engine allows one to understand, in a very natural way, his thermodynamical conclusion, Eq. 
(1), as a consequence of the conservation of information in a closed quantum system. 

The quantum version of Szilard's engine will be considered in the following section. Implications of Szilard's 
reasoning for quantum theory and for thermodynamics will be explored in Sec. Ill - where we shall assume that 
"Maxwell's Demon" is classical - and in Sec. IV, where it will be a quantum system. 



o 



II. QUANTUM VERSION OF SZILARD'S ENGINE 

_ _ I 

A complete cycle of Szilard's classical engine is presented in Fig. 1. The work it can perform in the course of one 
cycle is 



AW = p(v)dv = k B T dv/v = k B T\n2 (2) 

JV/2 JV/2 



Above, we have used the law of Gay-Lussac, p = kT/V, for one-molecule gas. This work gain per cycle can be 
maintained in spite of the fact that the whole system is at the same constant temperature T. If Szilard's model 
engine could indeed generate useful work, in the way described above at no additional expense of free energy, it would 



* This paper has appeared in 1984 as a Los Alamos preprint LAUR 84-2751. It is based on talks given by the author in 1983 and 1984, 
including an invited presentation at the APS Spring 1983 meeting. It was circulated as a preprint in 1984, and eventually published in 
Frontiers of Nonequilibrium Statistical Physics, NATO ASI Series B: Physics Vol. 135, G. T. Moore and M. O. Scully, eds. (Plenum, New 
York, 1986). It was also reprinted in Maxwell's Demon: Entropy, Information, Computing, H. S. Leff and A. F. Rex, eds. (Princeton 
University Press, 1990). The posted version is essential identical to the original, although a few typos have been corrected. 
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constitute a pcrpctuum mobile, as it delivers mechanical work from an (infinite) heat reservoir with no apparent 
temperature difference. To fend off this threat to the thermodynamic irreversibility, Szilard has noted that, "If we 
do not wish to admit that the Second Law has been violated, we must conclude that . . . the measurement . . . must 
be accompanied by a production of entropy." Szilard's conclusion has far-reaching consequences, which have not yet 
been fully explored. If it is indeed correct, it can provide an operational link between the concepts of "entropy" and 
"information." Moreover, it forces one to admit that a measuring apparatus can be used to gain information only if 
measurements are essentially irreversible. 

Before accepting Szilard's conclusion one must realize that it is based on a very idealized model. In particular, two 
of the key issues have not been explored in the original paper. The first, obvious one concerns fluctuations. One may 
argue that the one-molecule engine cannot be analyzed by means of thermodynamics, because it is nowhere near the 
thermodynamic limit. This objection is overruled by noting that arbitrarily many "Szilard's engines" can be linked 
together to get a "many-cylinder" version of the original design. This will cut down fluctuations and allow one to 
apply thermodynamic concepts without difficulty. 

A more subtle objection against the one-molecule engine has been advanced by Jauch and Baron. 4 They note that 
"Even the single-molecule gas is admissible as long as it satisfies the gas laws. However, at the exact moment when 
the piston is in the middle of the cylinder and the opening is closed, the gas violates the law of Gay-Lussac because 
gas is compressed to half its volume without expenditure of energy." Jauch and Baron ". . . therefore conclude that 
the idealizations in Szilard's experiment are inadmissible in their actual context . . ." This objection is not easy to 
refute for the classical one-molecule gas. Its molecule should behave as a billiard ball. Therefore, it is difficult to 
maintain that after the piston has been inserted, the gas molecule still occupies the whole volume of the container. 
More defensible would be a claim that while the molecule is on a definite side of the partition, we do not know on 
which side, and this prevents extraction of the promised UbT In 2 of energy. (This was more or less Szilard's position.) 
The suspicious feature of such argument is its subjectivity: Our (classical) intuition tells us that the gas molecule is 
on a definite side of a partition. Moreover, what we (or Maxwell's demons) know should have nothing to do with 
the objective state of the gas. It is this objective state of the gas which should allow one to extract energy. And, 
objectively, the gas has been compressed to half its volume by the insertion of the partition no matter on which side of 
the piston the molecule is. The eventual "observation" may help in making the engine work, but one may argue, as do 
Jauch and Baron, that the "potential to do work" seems to be present even before such a measurement is performed. 

To re-examine arguments of Jauch and Baron, consider the quantum version of Szilard's engine, shown in Fig. 1. 
The role of the container is now played by the square potential well. A single gas molecule of mass m is described by 
the (nonrelativistic) Schrodinger equation with the boundary conditions ip(—L/2) = ip(L/2) — 0. Energy levels and 
eigenfunctions are given by 



At a finite temperature T — l/(/3 ks) the equilibrium state of the system will be completely described by the 
density matrix: 



E = n 2 ir 2 h 2 /(2mL 2 ) = en 2 



(2#n) = 



(2/L)^ 2 cos2Trnx/L for n = 2k + 1 
(2/L) 1 / 2 sin 2TTnx/L for n = 2k 




(3) 



n 



Above, Z is the usual partition function: 



oo 



oo 




(4) 



For 1/2 < <r < I, Z can be adequately approximated by: 




(5) 



For our purposes a still simpler, high-temperature approximation 



Z = (ir/ef3) 1 / 2 /2 = L/ (h 2 /2mk B T) 



1/2 



(6) 
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valid for e <C fc^T, will be sufficient most of the time. This is, of course, the familiar Boltzmann gas partition function. 
It can be readily generalized to the three-dimensional box 

Z = L x L v L z /(h 2 /2Trmk B Tf/ 2 , (7) 

as well as to the case when there are N "classically" indistinguishable particles. The point of this elementary 
calculation is to demonstrate that, in the further analysis, we can rely on classical estimates of pressure, internal 
energy, entropy, etc. ... for one molecule gas which were used by Szilard 1 : A partition function completely determines 
thermodynamic behavior of the system. 

Consider now a "piston," slowly inserted in the middle of the potential well "box". This can be done cither (1) 
while the engine is coupled with the reservoir, or (2) when it is isolated. In either case, it must be done slowly, so that 
the process remains either (1) thermodynamically or (2) adiabatically reversible. We shall imagine the piston as a 
potential barrier of width d <C L and height that eventually attains U 3> ksT. The presence of this barrier will alter 
the structure of the energy levels: these associated with even n will be shifted " upwards" so that the new eigenvalues 
are: 

E' 2k = e'(2k) 2 + A k =E k + A k (8) 

where 

e' = eL 2 /(L - d) 2 (9) 

and 

A fe £* (4e'/n) cxp (-dy/2m(U - E k )/h) . (10) 

Energy levels corresponding to the odd values of n are shifted upwards by AE n <~ (2n + l)e' so that 

E' 2k _ x = e'(2k) 2 -A k = E k -A k (11) 

A pair of the eigenvalues E' 2k , E' 2k _ 1 can be alternatively regarded as the k th doubly degenerate eigenstate of the 
newly created two-well potential with degeneracy broken for finite values of U. 

For U — > oo exact eigenfunctions can be given for each well separately. For finite U, for these levels where A k <C E k , 
eigenfunctions of the complete potential can be reconstructed from the k th eigenfunctions of the left (\L k )) and right 
{\R k )) wells: 

E k + A k ~\iP+) = {\L k )-\R k ))/V2 (12a) 

E k -A k ^ ) = (\L k ) + \R k ))/V2 (12b) 

Alternatively, eigenfunctions of the left and right wells can be expressed in terms of energy eigenfunctions of the 
complete Hamiltonian 

\Lk) = Wt) + |C » ^ (12c) 

\R k ) = (m - 1^)) V2 (i2d) 

III. MEASUREMENTS BY THE CLASSICAL MAXWELL'S DEMON 

Consider a measuring apparatus which, when inserted into Szilard's engine, determines on which side of the partition 
the molecule is. Formally, this can be accomplished by the measurement of the observable 

n = X(\L)(L\-\R)(R\) . (13) 

Here A is an arbitrary eigenvalue while; 

N 

\L)(L\=J2\Lk)(L k \ , (13a) 
fe=i 
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N 

\R){R\ = J2\Rk){Rk\, (13b) 

and AT is sufficiently large, N 2 e[3 » 1. The density matrix before the measurement, but after piston is inserted, is 
given by 

P = Z-'EZieMm) {exp(-/3A fe )|^+)<V£|} (14) 
= Z- 1 Y^ 1 ew(-0Ek){™&(0*k)(\Lk)(Lk\ + \R k )(Rk\) + sinh(pA k )(\L k )(R k \ + \R k )(L k \)} 

Depending on the outcome of the observation, the density matrix becomes either pi or p^ where; 

oo 

PL = Z^J2 c M~PE k ) cosh (3 A k \L k )(L k \ , (15a) 
k=l 



p R = Z^ 1 ^exp(-/3^) cosh f3A k \R k )(R k \ . (15b) 
fe=i 

Both of these options are chosen with the same probability. The classical "demon" "knows" the outcome of the 
measurement. This information can be used to extract energy in the way described by Szilard. 

We are now in a position to return to the objection of Jauch and Baron. The "potential to do work" is measured 
by the free energy A(T, L) which can be readily calculated from the partition function 

A(T,L) = -k B T\nZ{T,L) . 

For the one-molecule engine this free energy is simply 

A = -k B Tln[L/(h 2 /2TTmk B T)^ 2 } 

before the partition is inserted. It becomes 

A = -k B T\n[{L - d)/(h 2 /2TTmk B T) 1 / 2 } (17) 

after the insertion of the partition. Finally, as a result of the measurement, free energy increases regardless of the 
outcome 

A L = -k B T\n[{{L-d)/2)h 2 /2nmk B T) 1 / 2 ] 
= -k B T{A-\u2) 

Let us also note that the change of A as a result of the insertion of the partition is negligible: 

A- A = k B T\n{L/{L- d)) ~ 0(d/L) . (19) 

However, the change of the free energy because of the measurement is precisely such as to account for the W — k B Tln 2 
during the subsequent expansion of the piston: 

A L - A = k B T\n2 . (20) 

It is now difficult to argue against the conclusion of Szilard. The formalism of quantum mechanics confirms the key 
role of the measurement in the operation of the one-molecule engine. And the objection of Jauch and Baron, based 
on a classical intuition, is overruled. 

The classical gas molecule, considered by Szilard, as well as by Jauch and Baron, may be on the unknown side of 
the piston, but cannot be on "both" sides of the piston. Therefore, intuitive arguments concerning the potential to do 
useful work could not be unambiguously settled in the context of classical dynamics and thermodynamics. Quantum 
molecule, on the other hand, can be on "both" sides of the potential barrier, even if its energy is far below the energy 
of the barrier top, and it will "collapse" to one of the two potential wells only if II is "measured." 



(16) 



(18) 
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It is perhaps worth pointing out that the density matrix p, Eq. (15), has a form which is consistent with the 
"classical" statement that "a molecule is on a definite, but unknown side of the piston" almost equally well as with 
the statement that "the molecule in in a thermal mixture of the energy eigenstates of the two-well potential." This 
second statement is rigorously true in the limit of weak coupling with the reservoir: gas is in contact with the heat 
bath and therefore is in thermal equilibrium. On the other hand, the off-diagonal terms of the very same density 
matrix in the \Lk), \Rk) representation are negligible (~ sinh/3Afc). Therefore, one can almost equally well maintain 
that this density matrix describes a molecule which is on an "unknown, but definite" side of the partition. The phase 
between \R n ) and \L n ) is lost. 

The above discussion leads us to conclude that the key element needed to extract useful work is the correlation 
between the state of the gas and the state of the demon. This point can be analyzed further if we allow, in the next 
section, the "demon" to be a quantum system. 



IV. MEASUREMENT BY "QUANTUM MAXWELL'S DEMON" 

Analysis of the measurement process in the previous section was very schematic. Measuring apparatus, which has 
played the role of the "demon" simply acquired the information about the location of the gas molecule, and this was 
enough to describe the molecule by pl or p R . The second law demanded the entropy of the apparatus to increase in 
the process of measurement, but, in the absence of a more concrete model for the apparatus it was hard to tell why 
this entropy increase was essential and how did it come about. The purpose of this section is to introduce a more 
detailed model of the apparatus, which makes such an analysis possible. 

We shall use as an apparatus a two-state quantum system. We assume that it is initially prepared by some external 
agency - we shall refer to it below as an "external observer" - in the "ready to measure" state \Dq). The first stage 
of the measurement will be accomplished by the transition: 

\L n )\D ) -> \L n )\D L ) (21a) 



\R n )\D ) - \R n )\D R ) (21b) 

for all levels n. Here, \D R ) and \Dl) must be orthogonal if the measurement is to be reliable. This will be the case 
when the gas and the demon interact via an appropriate coupling Hamiltonian, e.g.: 

H int = iS(\L n )(L n \ - \R n )(R n \) (\D L )(D R \ - \D R )(D L \) (22) 

for the time interval At = 7rfi./(4(5) 5 ' 6 , and the initial state of the demon is: 

\D ) = (\D L ) + \R R ))/V2 (23) 

For, in this case the complete density matrix becomes: 

P = cxp (-iH mt At/h) p\D ) (D \ S (p L \D L ) (D L \ + p R \D R )(D R \) /2 (24) 

Here and below we have omitted small off-diagonal terms ~ /3A n present in p, Eq. (14) and, by the same token, we 
shall drop corrections (~ /3 2 A 2 ) from the diagonal of pl and p R . As it was pointed out at the end of the last section, 
for the equilibrium there is no need for the "reduction of the state vector." The measured system - one molecule gas 
- is already in the mixture of being on the left and right-hand side of the divided well. 

To study the relation of the information gain and entropy increase in course of the measurement, we employ the 
usual definition of entropy in terms of the density matrix 3,6 ' 7,8 

S(p) = -k B Trp In p (25) 

The information is then: 

I{p) = ln(DimH) - S(p)/k B , (26) 

where TL is the Hilbert space of the system in question. Essential in our further discussion will be the mutual 
information I^(Pab) defined for two subsystems, A and B, which are described jointly by the density matrix Pab, 
while their individual density matrices are pa and pa- 



I^Pab) = I(Pab) - (I(pa) + I{pb)) 



(27) 
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In words, mutual information is the difference between the information needed to specify A and B one at a time 
and jointly. When they are not correlated, Pab = PaPb, then I^Pab) = 0. The readoff of the location of the gas 
molecule by the demon will be described by an external observer not aware of the outcome by the transition: 

p\D )(Do\ ^ ( P l\D l )(D l \ + PR \D R )(D R \) /2 (28) 

The density matrix of the gas is then: 

P = Z~ x CX P (-^n 2 ) (\L n )(L n \ + \R n )(R n \) = (p L + p R ) /2 (29) 

71=1 

Thus, even after the measurement by the demon, the density matrix of the gas, pa will be still: 

p G = (D L \P\D L ) + (D R \P\D R ) = p (30) 
The state of the demon will, on the other hand, change from the initial pure state |Do)(-Do| into a mixture: 

PD = E i( L n\P\L n ) + (Rn\P\Rn)) = (\Dl)(D l \ + \D R )(D R \) /2 (31) 

n 

Entropy of the gas viewed by the external observer remains constant: 

S{p G ) = S{p) = d((3\aZ)/d(3 (32) 
Entropy of the demon has however increased : 

S(p D )-S{\D ){D \) = k B \n2 (33) 

Nevertheless, the combined entropy of the gas-demon system could not have changed: In our model evolution during 
the read-off was dynamical, and the gas-demon system was isolated. Yet, the sum of the entropies of the two 
subsystems - the gas and the demon - has increased by fee In 2. The obvious question is then: where is the "lost 
information" AI = I(P) — (Pyp) + /(pu))? The very form of this expression and its similarity to the right-hand side 
of Eq. (27) suggests the answer: The loss of the information by the demon is compensated for by an equal increase 
of the mutual information: 

AI^=I^P)-I^p\D ){D \) . (34) 

Mutual information can be regarded as the information gained by the demon. From the conservation of entropy 
during dynamical evolutions it follows that an increase of the mutual information must be compensated for by an 
equal increase of the entropy. 

AJ„ - AS/k B = (35) 

This last equation is the basis of Szilard's formula, Eq. (1). 

At this stage readoff of the location of the gas molecule is reversible. To undo it, one can apply the inverse of the 
unitary operation which has produced the correlation. This would allow one to erase the increase of entropy of the 
demon, but only at a price of the loss of mutual information. 

One can now easily picture further stages of the operation of Szilard's engine. The state of the demon can be used to 
decide which well is "empty" and can be "discarded." 6 The molecule in the other well contains twice as much energy 
as it would if the well were adiabatically (i.e. after decoupling it from the heat reservoir) expanded from its present 
size <~ L/2 to L. Adiabatic expansion conserves entropy. Therefore, one can immediately gain AW = (E)/2 = k R T/4 
without any additional entropy increases. One can also gain AW = ksT\n2, Eq. (2), by allowing adiabatic expansion 
to occur in small increments, in between which one molecule gas is reheated by the re-established contact with the 
reservoir. In the limit of infmitesimally small increments this leads, of course, to the isothermal expansion. At the 
end the state of the gas is precisely the same as it was at the beginning of the cycle, and we are AW "richer" in 
energy. If Szilard's engine could repeat this cycle, this would be a violation of the second law of thermodynamics. 
We would have a working model of a perpctuum mobile, which extracts energy in a cyclic process from an infinite 
reservoir without the temperature difference. 

Fortunately for the second law, there is an essential gap in our above design: The demon is still in the mixed state, 
Pb, Eq. (31). To perform the next cycle, the observer must "reset" the state of the demon to the initial \D ). This 
means that the entropy dS = fcsln2 must be somehow removed from the system. If we were to leave demon in 
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the mixed state, coupling it with the gas through Hi nt will not result in the increase of their mutual information: 
The one-bit memory of the demon is still filled by the outcome of the past measurement of the gas. Moreover, this 
measurement cannot any longer be reversed by allowing the gas and the demon to interact. For, even though the 
density matrix of each of these two systems has remained the same, their joint density matrix is now very different: 

p® p D = {( PL \D L )(D L \ + p R \D R ){D R \)/2 + ( PL \D R )(D R \ + p R \D L )(D L \)/2} (36) 

One could, presumably, still accomplish the reversal using the work gained in course of the cycle. This would, however, 
defy the purpose of the engine. The only other way to get the demon into the working order must be executed by an 
"external observer" or by its automated equivalent: The demon must be reset to the "ready-to-measure" state \Dq). 

As it was pointed out by Bennett in his classical analysis, this operation of memory erasure is the true reason for 
irreversibility, and the ultimate reason why the free energy, Eq. (1), must be expended. 9 Short of reversing the cycle, 
any procedure which resets the state of the demon to \D ) must involve a measurement. For instance, a possible 
algorithm could begin with the measurement whether the demon is in the state \D R ) or in the orthogonal state 
\Dl). Once this is established then, depending on the outcome, the demon maybe rotated either "rightward" from 
\Dl), or "leftward" from \D R ) so that its state returns to \Dq). The measurement by some external agency - some 
"environment" - is an essential and unavoidable ingredient of any resetting algorithm. In its course entropy is "passed 
on" from the demon to the environment. 



V. SUMMARY 

The purpose of our discussion was to analyze a process which converts thermodynamic energy into useful work. 
Our analysis was quantum, which removed ambiguities pointed out by Jauch and Baron in the original discussion 
by Szilard. We have concluded that validity of the second law of thermodynamics can be satisfied only if the 
process of measurement is accompanied by the increase of entropy of the measuring apparatus by the amount no 
less than the amount of gained information. Our analysis confirms therefore conclusions of Szilard (and earlier 
discussion of Smoluchowski 10 , which has inspired Szilard's paper). Moreover, we show that the ultimate reason for 
the entropy increase can be traced back to the necessity to "reset" the state of the measuring apparatus 9 , which, 
in turn, must involve a measurement. This necessity of the "readoff" of the outcome by some external agency - 
the environment of the measuring apparatus - has been already invoked to settle some of the problems of quantum 
theory of measurements 11 . Its role in the context of the above example is to determine what was the outcome of the 
measurement, so that the apparatus can be reset. In the context of quantum measurements its role is very similar: it 
forces one of the outcomes of the measurement to be definite, and, therefore, causes the "collapse of the wavepacket." 

In view of the title of Szilard's paper, it is perhaps worthwhile to point out that we did not have to invoke 
"intelligence" at any stage of our analysis: all the systems could be presumably inanimate. However, one can imagine 
that the ability to measure, and make the environment "pay" the entropic cost of the measurement is also one of the 
essential attributes of animated beings. 
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FIG. 1 A cycle of Szilard's engine, a) Original, classical version; b) Quantum version discussed here. The measurement of the 
location of the molecule is essential in the process of extracting work in both classical and quantum design. 



